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Abstract 


v  Consideisa  multinomial  population  with  Jfc(>  2)  cells  and  the  associated  probability 
vector,  p  =  (pi, . . .  ,pfc).  Let  p[*j  =  max  pj.^A  cell  associated  with  p[t]  is  called  the  most 

probable  event.  We  are  interested  in  selecting  the  most  probable  event.  Let  t  denote 

1. 

the  index  of  the  selected  cell.  Under  the  loss  function  Z/(p,t)  =  P[*]  -  Pi,  this  statistical 
selection  problem  is  studied  via  a  parametric  empirical  Bayes  approach.  Two  empirical 
Bayes  selection  rules  are  proposed.  They  are  shown  to  be  asymptotically  optimal  at  least 
of  order  0(exp(— c^n))  for  some  positive  constants  c,-,  t  =  1,2,  where  n  is  the  number  of 
accumulated  past  experience  (observations)  at  hand. 
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1.  Introduction 


Consider  a  multinomial  population  with  k  >  2  cells  and  the  associated  probability 

k 

vector  2  —  (Pi.---.Pfc)  where  £  Pi  =  1-  Let  pjj]  <  ...  <  p[fc]  denote  the  ordered  values 

»= l 

of  the  parameters  Pi,...,Pfc.  It  is  assumed  that  the  exact  pairing  between  the  ordered 
and  the  unordered  parameters  is  unknown.  Any  event  associated  with  p[*)  is  considered 
as  the  most  probable  event.  A  number  of  statistical  procedures  based  on  single  samples  or 
sequential  sampling  rules  have  been  considered  in  the  literature  in  the  classical  framework 
for  selecting  the  most  probable  event.  Bechhofer,  Elmaghraby  and  Morse  (1959)  have 
considered  a  fixed  sample  procedure  through  the  indifference  zone  approach.  Gupta  and 
Nagel  (1967),  Panchapakesan  (1971)  and,  Gupta  and  Huang  (1975)  have  studied  this 
selection  problem  using  a  subset  selection  approach.  Cacoullos  and  Sobel  (1966),  Alam 
(1971),  Alam,  Seo  and  Thompson  (1971),  Ramey  and  Alam  (1979,  1980)  and  Bechhofer 
and  Kulkarni  (1984)  have  considered  sequential  selection  procedures. 

We  now  consider  a  situation  in  which  one  repeatedly  deals  with  the  same  selection 
problem  independently.  In  such  instances,  it  is  reasonable  to  formulate  the  component 
problem  in  the  sequence  as  a  Bayes  decision  problem  with  respect  to  an  unknown  (or 
partially  known)  prior  distribution  on  the  parameter  space,  and  then,  use  the  accumu¬ 
lated  observations  to  improve  the  decision  rule  at  each  stage.  This  is  the  empirical  Bayes 
approach  due  to  Robbins  (1956,  1964  and  1983). 

Empirical  Bayes  rules  have  been  derived  for  subset  selection  goals  by  Deely  (1965). 
Recently,  Gupta  and  Hsiao  (1983)  and  Gupta  and  Leu  (1983)  have  studied  empirical 
Bayes  rules  for  selecting  good  populations  with  respect  to  a  standard  or  a  control  with  the 


underlying  populations  being  uniformly  distributed.  Gupta  and  Liang  (1984,  1986)  have 
studied  empirical  Bayes  rules  for  the  problem  of  selecting  the  best  binomial  population 
or  selecting  good  binomial  populations.  Many  such  empirical  Bayes  procedures  have  been 
shown  to  be  asymptotically  optimal  in  the  sense  that  the  risk  for  the  nth  decision  problem 
converges  to  the  optimal  Bayes  risk  which  could  have  been  obtained  if  the  prior  distribution 
was  fully  known  and  the  Bayes  procedure  with  respect  to  this  prior  distribution  was  used. 

Note  that  the  above  mentioned  empirical  Bayes  rules  use  the  so-called  nonparametric 
empirical  Bayes  approach.  That  is,  one  assumes  that  the  form  of  the  prior  distribution 
is  unknown.  However,  in  many  cases,  an  experimenter  may  have  some  prior  information 
about  the  parameters  of  interest,  and  he  would  like  to  use  this  information  to  make  ap¬ 
propriate  decisions.  Usually,  it  is  suggested  (for  example,  see  Robbins  (1964)),  that  the 
prior  information  is  quantified  through  a  class  of  subjectively  plausible  priors.  In  view  of 
this  situation,  in  this  paper,  it  is  assumed  that  the  parameters  of  interest  in  a  multinomial 
distribution  follow  some  conjugate  prior  distribution  with  unknown  hyperparameters.  Un¬ 
der  this  statistical  framework,  two  empirical  Bayes  selection  rules  are  proposed.  They  are 
shown  to  be  asymptotically  optimal  at  least  of  order  0(exp(-c,n))  for  some  positive  con¬ 
stants  C{,  i  =  1,2,  where  n  is  the  number  of  accumulated  past  experience  (observat  ions) 
at  hand. 

2.  Formulation  of  the  Problem  under  the  Empirical  Bayes  Approach 

Consider  a  multinomial  population  with  k(>  2)  cells,  where  the  cell  7r,  has  probabilit  y 
p,,  i  —  Let  X,  denote  the  observations  that  arise  in  the  cell  n,  based  on  N (>  2) 


independent  trials.  Thus,  for  given  p  =  (pi,...,pk),X  =  (Xu . . . ,  A*)  has  the  probability 
function 


(2i)  /(?Ii>)  =  t^- ]}>>.■'. 

n  w)  — 

»=1 

k 

where,  x ,  —  0, 1, . . . ,  N  and  ^  xi  =  N- 

t=l 

For  each  p,  let  pjj]  <  . . .  <  P[jt]  denote  the  ordered  parameters  pj, . .  • , pjt ■  It  is  assumed 
that  there  is  no  apriori  knowledge  about  the  exact  pairing  between  the  ordered  and  the 
unordered  parameters.  Any  cell  associated  with  p[*j  is  considered  as  the  most  probable 

event.  Our  goal  is  to  derive  empirical  Bayes  rules  to  select  the  most  probable  event. 

k 

Let  17  =  {p|p  =  (pi, . . .  ,pfc),  0  <  pi  <  1  and  JT  p,  =  1}  be  the  parameter  space.  It  is 

»=l 

assumed  that  p  has  a  Dirichlet  prior  distribution  G  with  hyperparameters  a  =  (cti , . . . ,  or*), 
where  all  at  are  positive  but  unknown.  That  is,  p  has  a  probability  density  function  of  the 
form 


(2-2)  g(S)  =  f]p ?■-*,  0  <  p,  <  1,  =  1, 

n  r(«i) 

i  =  1 
fc 

where  ao  ~  ^2  a«- 

t=i 

Let  A  -  { 1 1 1  =  l,...,fc}  be  the  action  space.  When  action  t  is  taken,  it  means  that 
the  cell  7r,  is  selected  as  the  most  probable  event.  For  the  parameter  p  and  action  t,  the 
loss  function  L(p, t)  is  defined  as 


the  difference  between  the  most  probable  and  the  selected  event. 


Let  X  be  the  sample  space  of  X  =  (Xj,. . .  ,  X*).  A  selection  rule  d  =  .  ,  dk)  is  a 

mapping  from  X  into  [0,l]fc  such  that  for  each  xeX,  the  function  d(x)  =  (dy  (x), . . . ,  dfc(x)) 

k 

is  such  that  0  <  di(x)  <  1,  i  =  1, . . . ,  k,  and  £  di(x)  =  1.  Note  that  d{(x),  i  -  1, . . . ,  A: 

i=i 

is  the  probability  of  selecting  cell  1T{  as  the  most  probable  event  given  X  —  x. 

Let  D  be  the  class  of  all  selection  rules  as  defined  above.  For  each  deD,  let  r{C,d) 

denote  the  associated  Bayes  risk.  Then  r(G)  =  inf  r[G,d)  is  the  minimum  Bayes  risk. 

dcD 

For  each  xeX ,  let 

(2-4)  A{x)  =  {i|x,-  +  a,  =  max  (xy  +  ay)}. 


Consider  the  selection  rule  do  —  (die, . .  .,dkc)  defined  below:  for  each  i  =  1, . . . ,  k, 


(2.5) 


if  ieA(x), 
otherwise, 


where  |A|  denotes  the  cardinality  of  the  set  A. 


A  straightforward  computation  shows  that  the  selection  rule  do  is  a  randomized  Bayes 
selection  rule  in  the  class  D.  Since  the  values  of  the  hyperparameters  (ai,...,e*fc)  are 
unknown,  it  is  impossible  to  apply  this  Bayes  selection  rule  dc  for  the  selection  problem 
at  hand.  As  we  mentioned  above,  we  study  this  selection  problem  via  empirical  Bayes 
approach. 


For  each  j  —  1,2, . . .,  let  Xy  —  (Xiy,  — ,  X*y)  denote  the  random  observations  arising 
from  N  independent  trials  at  stage  j.  Let  Py  =  (Piy, . . . ,  Pk])  denote  the  (random) 
parameters  at  stage  j.  Conditional  on  Py,  Xy  has  a  probability  function  of  the  form  <>l 


(2.1).  It  is  assumed  that  independent  observations  Xit . . . , Xn  are  available,  and  Pj,  1  < 
j  <  n,  have  the  same  prior  probability  density  function  of  the  form  (2.2),  though  not 
observable.  We  also  let  Xn+i  =  X  =  (Xi,. . .  ,Xk)  denote  the  present  observations. 

Two  empirical  Bayes  selection  rules  are  proposed  depending  on  whether  the  value  of 
the  parameter  a0  is  known  or  unknown.  Note  that  ao  is  the  sum  of  all  the  parameters 
a,,  1  <»'<&.  Ii-  ase  that  ao  is  known,  the  individual  values  of  <**,  1  <  i  <  k,  are 
still  unknov 

First,  for  each  i  =  l,..  .,k,  and  each  n  =  1,2, . . . ,  we  let 

'  =  it  =  i  t  X%, 

i= i  y=i 

(2-6)  Z,(n)  =  [NXi{n)  -  M,(n)]X,(n),  and 

,  Vi(n)  =  (Af<(»)  -  X,(n)]JV  -  (JV  -  l)(X,(n))2. 


When  a0  is  known,  let 


(2.7) 


and  let 


(2.8) 


ain  =  a0Xi(n)N  \ 


^4n(?)  =  {»>.  +  «.n  = 


We  then  define  an  empirical  Bayes  selection  rule  dn  =  (din,  •  -  ■  »d*n)  as  follows:  for 
each  t  =  1, . . . ,  k,  xeX, 


(2.9) 


din(x)  =  (  l^"(?)l  1  * 

(0  otherwise. 


When  ao  is  unknown,  we  first  let 

/  Xi  +  Zi(n)/r((n)  if  (Z,(»)  >  0  and  *(«)  >  0), 
(2.10)  a,n(i.)  -  |  Xi  otherwise. 


Also,  let 


(2.11) 


<(?)  =  {t|Ain(x<)  =  maxfcAjn(iy)}. 


We  then  define  an  empirical  Bayes  selection  rule  d*  =  (d*n, . . . ,  d*kn)  as  follows:  lot- 


each  i  =  1, . . . ,  fc,  xeX , 


(2.12) 


d*  (i)  =  (  K(?)l  1  5f  ieAn{*) 

lo  otherwise. 


In  the  next  section,  we  will  study  the  optimality  of  the  two  sequences  of  empirical 
Bayes  selection  rules  {dn}  and  {d* }. 


3.  Asymptotic  Optimality  of  Selection  Rules  {d„}  and  {d* } 

Consider  an  empirical  Bayes  selection  rule  dn{ x).  Let  r(G,dn)  be  the  Bayes  risk 
associated  with  the  selection  rule  d„(x).  Then  r(G,dn)  -  r(G)  >  0,  since  r(G)  is  the 
minimum  Bayes  risk.  The  nonnegative  difference  is  always  used  as  a  measure  of  optimality 
of  the  selection  rule  dn. 


Definition  3.1.  A  sequence  of  empirical  Bayes  rules  {dn}^_i  is  said  to  be  asymptot¬ 
ically  optimal  at  least  of  order  0n  relative  to  the  prior  distribution  G  if  r(G,dn)  -  '(G)  < 
0(/?n)  as  n  — ♦  oo,  where  {0n}  is  a  sequence  of  positive  values  satisfying  lim  /?„  =  0. 


3.1.  Asymptotic  Optimality  of  {d„}. 


We  first  consider  the  case  where  ao  is  known.  Note  that  a,n  is  an  unbiased  estimator 

k 

of  a*;  also  Y1  a»r»  —  «o  for  each  n  =  1,2,.... 

»=i 
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For  each  xcX ,  let  A(x)  be  as  defined  in  (2 A)  and  let  B{ x)  -  {1,2, . . . ,  k}\A(x).  Thus, 
for  each  xtX ,  iev4(x),  jeB(x),  x,  +  a,  >  Xy  +  ct} ■.  Following  straightforward  computation, 
we  can  show 

0  <  r(G,dn)  —  r(G) 

(3-1)  <  Y1  E  H  -P{*»  +  Q!*n  <  Xy  +  ayn}. 

XtX  ieA(X)  j'tB(X) 

Now,  for  ieA(x),  jeB(x), 

P{  Xi  +  —  xj  “|"  OCj  n } 

1  %  1  1 

=  y  ]  f  ~  ^j‘m)  “  ~(tti  —  <*>)}  <  ~{x\  +  &i  “  xj  **"  } 

m=  1  0 

(3.2)  <  P{I  £ -  X,„)  -  ±(a,  -  «,)!  < 

m=  1  0 

<  exp{— n2-1e?,} 

<  exp{— nc!}, 

where 

£■,;  =  mm{|x,  +  <*,•-  xy  -  ay|ao  ‘|x,-,xy  =  0, 1, . . . , JV,0  <  x,  +  x}  <  N, 

(3.3)  x,  +  ai  -  xy  -  ay  ^  0} 

>  0  since  N  is  a  finite  number  . 

and 


(3.4) 


ci  =  2  ’min  {e»y  |i,  j  =  i  f  j}  >  0. 


7vyv  ~  Ts .  / 


•L*  v’O  V  V. 


In  (3.2),  the  second  inequality  is  obtained  using  the  fact  that 


E\  Xjm)  (<*»'  aj)]  ~  0) 

JV  a0 

—  1  —  (o!j  —  Of jf )  <  —  (Xim  —  Xj m)  —  (a,  —  O (y)  <  1  —  [o-i  —  Oj) 

olq  jv  ao  tto 


and  then  making  use  of  Theorem  2  of  Hoeffding  (1963). 


By  noting  that  Jf  is  a  finite  space,  from  (3.1)  and  (3.2),  we  have  the  following  thcore 


Theorem  3.1.  Let  { dn }  be  the  sequence  of  empirical  Bayes  selection  rules  defined 
in  (2.9).  Then  r(G,dn)  —  r(G)  <  0(exp  (— Ci«))  for  some  positive  constant  C\. 


3.2.  Asymptotic  Optimality  of  {d*}. 


For  each  xeX,  let  A(x)  and  B{ x)  be  as  defined  in  the  previous  sections.  For  the 
section  rule  d* ,  one  can  obtain  the  following  result 


0<r(G,d;)-r(G) 

<3-5)  <EE  E  f>{Ain(xO  <  Ay.fx,)}. 

XtX  itA(X)  jiB(X) 

Since  X  is  finite,  we  only  need  to  consider  the  behavior  of  P{Atn(xt)  <  Ajn(zj)}  fo 
each  xeX.  Now 


P{Ain(x,)  <  Ayn(x;)} 

(3.6)  =  P{A,n(x,)  <  Ay„(iy)  and  (Z,(n)  <  0  or  Z}(n)  <  0  or  V,(n)  <  0  or  F;(r i)  ())} 

+  ^>{Ai„(x,)  <  Ayn(xy)  and  (Z,(n)  >  0,  Z}(n)  >  0,  Y,(n)  >  0  and  Y}(n)  ■  0)}. 


Before  we  go  further  to  study  the  associated  asymptotic  behaviors  of  the  above  prob¬ 
abilities  appearing  on  the  right  hand  side  of  (3.6),  we  need  some  notation  and  a  lemma. 

Let  m i  =  E[X,(n)]  and  n*2  =  E [M,(n)].  Then,  following  a  direct  computation, 
wc  have  Hu  =  N ata ^ \  M12  =  Arato: q  1  +  ( N 2  -  iV)ot(a,  +  l)^  ^ao  +  l)-1.  Hence, 
a,  -■=  LhL;2\  where  Ltl  =  (N  Hu  -  Mi2)Mii>£i2  =  (m«2  -  Mil )N  —  (N  —  1)m^- 

Note  that  Ltl  and  L, 2  are  both  positive,  which  can  be  verified  directly  by  the  definition 
of  Hi  1  and  Hi 2- 

Lemma  3.1.  Let  b  >  0  be  a  constant.  Then, 

a)  P{Zt(n )  -  Ln  <  -6}  <  0(exp(-6,n)); 

b)  P{Zt(n)  -  Lix  >  b}  <  0(exp(-6,n)); 

c)  P{y,(n)  -  Li 2  <  -6}  <  0(exp(-6,n)); 

d)  P{Yi{n)  -  L{ 2  >  b}  <  0(exp(-6,n)); 

where  6,  —  b2\2N4(N  +  Mil)2]-1  >  0. 

Proof:  The  techniques  used  to  prove  these  four  inequalities  are  similar.  Here,  we  give  the 
proof  of  part  a)  only. 

Note  that  Z,(n)  =  [N Xt{n)  -  Mt(n)\Xi[n)  >  0.  Hence,  P{Zt(n)  -  Ln  <  - b }  =  0  if 
Li  1  -  b  <  0.  So,  we  assume  that  6  >  0  is  small  enough  so  that  Lx\  —  b  >  0.  Then, 


P{Zi{n )  -  Lu  <  —6} 

=  P{JV[(X,(n))2  -  /in]  “  [Mt(n)X,(»)  -  Mt2M»i]  <  ~b} 

<  P{Xi(n)-Hi i  <  -b(2N{N  +  fa i))-1} 

(3.7)  +  P{X,(n)  -  Mil  >  6(4AT2)~1}  +  P{M<(n)  -  Mi2  >  &(4m»x)-1} 

<  exp{-n62[27V4(iV  +  Mil)2]-1} 

+  exp{— n62[8JV4]-1}  +  exp{— nfc2[87V4Mii]-1} 

<  0(exp(— nbi)). 

Note  that  in  (3.7),  the  first  inequality  is  obtained  from  the  fact  that  0  <  Xi(n)  <  TV,  0  < 
M,  (n)  <  TV2  and  an  application  of  Bonferroni’s  inequality;  the  second  inequality  follows 
from  an  application  of  Theorem  2  of  Hoeffding  (1963)  and  the  last  inequality  is  obtained 
from  the  definition  of  6,. 

Hence,  the  proof  of  part  a)  is  complete. 

By  the  positivity  of  Lu  and  La,  and  by  Lemma  3.1, 

P{Ain(i,)  <  Ajn(xj)  and  ( Z,(n )  <  0  or  Zj(n)  <  0  or  Yj{n)  <  0  or  Y}(n)  <  0)} 

(3.8)  <  0(exp(— n  min(6i,6y))) 

=  0(exp(— n6,y)),  where  6tJ  =  min  (6i, fry). 

Therefore,  we  then  only  need  to  consider  the  asymptotic  behavior  of  P{Alf, (./•,)  ■ 
Ajn(xj)  and  (Zt(n)  >  0,  Zj (n)  >  0,  Kj(n)  >  0  and  Yj(n)  >  0)}. 
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Let  Qij  -  (x,  -  Xj)Li2Lj2  +  L{\Lj2  -  Lx2Lj\.  Then  Q,y  >  0  if  ieA(x)  and  jtB(x) 


Therefore, 


P{A,„(x,)  <  A y„(xy)  and  (Z,(n)  >  0 ,Zj(n)  >  0, K,(n)  >  0  and  Yj{n)  >  0)} 
(3.9)  <  P{(x,  -  Xj)[Yi{n)Yj{n)  -  Li2Lj2\  <  -Q.y/3} 

+  P{Zi(n)Yj(n)  -  LaLj2  <  -Q,y/3} 

+  P{K,(n)Zy(n)  -  Li2Lix  >  Q*y/3}. 


With  repeated  applications  of  Bonferroni’s  inequality,  we  have  the  following  inequali 


P{(x,  -  xy)[y,(n)Vy(n)  -  Lx2Lj2\  <  -Q.y/3} 

(3. 10. a)  <  P{K,(«)  -  Li2  <  ~ Qij (6AT4)-1}  +  P{V, («)  "  ^j2  <  -Qij(6N Li2)~1} 

if  Xi  >  ij\ 


P{(x,  -  xy)[yy(n)ry(n)  -  L,2Lj2\  <  -Qi y/3} 

(3.10.6)  <  P{K,(n)  -  L,2  >  Qij(6N4)-'}  +  P{Y}(n )  -  L}2  >  Qij{6NLi2)~1} 

if  Xi  <  Xj ; 


(3.10.c) 


P{(xt  -  x;)[y,(n)yy(n)  -  Li2Li2\  <  -Q,y/3}  =  0  if  x,  =  x>; 


P{Zj(n)Vj(n)  -  LixLj2  <  -Q, y/3} 

(3.11)  <  P{Z,(n)  -  <  -g,;(6^3)-1}  +  P{Ky(n)  -  Ly2  <  -Q,;(6L, ,)"'}; 


and 


P{Yi{n)Zj(n)  -  LnLjx  >  Qij/ 3} 

(3.12)  <  P{Yj(n)  -  1,2  >  Q0(6N3)"1}  +  P{Zj{n)  -  L,i  >  Qij{6Lt2)'1}. 

Then,  by  Lemma  3.1  and  from  Equations  (3.9)  through  (3.12),  we  conclude  that 

P{Ain(z,)  <  Ajn(xj)  and  (£,(»)  >  0,Zy(n)  >  0,  Yi(n)  >  0  and  Yy(n)  >  0)} 

(3.13)  <  0(exp(— naij))  for  some  a,y  >  0. 

Now,  from  (3.6),  (3.8)  and  (3.13),  for  each  xeX,  *ev4(x)  and  jeB[x ), 

(3.14)  P{A, •„(£,■)  <  Ayn(zy)}  <  0(exp(-»  min(6<y,a,ji))). 

Now,  let  C2  =  rmn{min(6tJ,  a,y)}.  Then  C2  >  0. 

Based  on  the  preceding,  we  have  the  following  result. 

Theorem  3.2.  Let  {d^}  be  the  sequence  of  empirical  Bayes  selection  rules  defined 
in  (2.12).  Then  r(G,d*n)  -  r(G)  <  0(exp(-c2n))  for  some  positive  constant  c2. 

Remark:  One  of  the  selection  problems  related  to  multinomial  distribution  is  to  select 
the  least  probable  event;  that  is,  to  select  the  cell  associated  with  p[ij.  If  we  consider  the 
loss  function 

(3.15)  L{p,i)  =pi  -P|i], 
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the  difference  between  the  selected  and  the  least  probable  event,  then  under  the  statistical 
model  described  in  Section  2,  a  uniformly  randomized  selection  rule  is  da  =  [d\G,  dkG ), 
where,  for  each  t  =  1, . . . ,  k, 


(3.16) 


diG  =  diG 


-1 


if  teA(x), 
otherwise, 


and 


(3.17) 


A{x)  =  {t'|xi  +  a<  = 


min  (a,  +  x,)}. 
i<i<* 


Let  a,n,Atn(xi)  be  defined  as  in  (2.7)  and  (2.10),  respectively.  When  a0  is  known, 
we  let 


(3.18) 


A„(x)  =  {*!*«  +  ««»  =  ^(x,  +  ayn)}, 


and  define  a  randomized  selection  rule  dn{x)  =  (J,n(x), . . .  ,dkn(x))  as  follows: 


(3.19) 


if  »'eAn(?), 

otherwise. 


When  a0  is  unknown,  we  let 

(3.20)  A;(x)  =  (i'|Ai„(xi)  =  ,minfc  A;n(x;)}, 


and  define  a  randomized  selection  rule  d*(x)  =  {d\n{x), . . .  ,d*kn{x))  as  follows: 


(3.21) 


if  .-.*(«). 

otherwise. 
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Following  a  discussion  analogous  to  that  given  earlier  for  the  most  probable  event, 
we  can  see  that  {dn}  and  {d* }  are  both  asymptotically  optimal  and  have  the  following 
convergence  rates: 

0  <  r(G,dn)  -  r(G)  <  0(exp(-c3n)), 

0  <  r(G,d*n)  -  r(G )  <  0(exp(-c4n)), 

for  some  positive  constants  c3  and  e4,  where  r(G)  now  denotes  the  minimum  Bayes  risk 
with  respect  to  the  loss  function  (3.15). 
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